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ABSTHA.CT 

The Office of ^caaemic Support and Instructional 
Services (OASIS) at the Oniversity of California^ San Diego 
administers an Instructional Katerials Development Programt An 
overview of the program is presented along with a fiescripticn of the 
product aevelopEient/evaluation cycle. Program evaluation is generic 
to this procesB, since several fornative evaluation steps are 
intrinsic to the product development cycle* The OASIS Orientation 
Program is used to illustrate the application of the product 
development cycle to a particular project, and evaluation data that 
was gathered in the process is presented. Summaries of progress are 
presented for the projects producing self-instr ucttonal sodules for 
nota^taking instruction, A description of the development of the 
OASIS media playback center is also provided. (Author/JMF) 
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Tha OASIS Instructional Materials Development (IMD) PrograTn 
is designed to provide assistance to UCSD faculty and staff in 
the davelopment of inst ructional materials of various types. 
Tho Coordinator for Instructional Materials Development works 
with -contenit expefts to aid in the planning of and the production 
of in.struct ional matGrials. lie also carries out evaluation basod 
improivements of the initial instructional products with assis^ 
tancc from the OASIS Director avid Coordinator for Research and 
Evaluation. This docun^ent was prepared as a report to the 
Chancellor's AdvLaory Committee on instructional Improvement 
Projects and as a method for providing feedback for continual 
mnnitorinq and program improvement . 

Formative and sunimative ovaluation of instructional rnatorials 
are an integral part of product development. Because evaluation 
iiS an intrinsic part of the prodnct development cycle, the evalua» 
tioo of the proqrain is a natural concomitant of this process. 
Since the TMD activitio« aro by nature a project orienhnd pro- 
qram, the evaluation is herein presented on a pro ject-^by-pro ject 
basis, according to the mechanisms dictatad by the product develop- 
m,ent •eycle. 

p r'^du.ct Deve l^nffmeti t Cycle 

Fiigure 1 presents a graphic representation of the product 
df:}volopment cycle used for the development of instructional 
ma^nrialB (SouthwpRt Rr^qlonail Laboratory for Educational KeBearch 
and Development, 1975)- The cycle proceeds by a sequance of 12 
steps /, each step- irwolving the materials developer,, content 
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experts, or both* 

The first stap invDlves the specification of instructional 
goals by tae cootfsnt expert. Typdcally the content expert has 
detarminod the eKistcjnce of uninet needs which he or she hopes 
tlie proposed instructional materials will satisfy. 

When the content oxpert has specified the goals of the pro-^ 
]<}.'cLf. th'-: i n. ^ t r uct iona I injiteriniB dove lope r workH with tiie con- 
Li^nt fMcport to specify detailed instructional objectives corres- 
ponding to those goals and to the project concept. At this 
ntage^ the materials developer ali^o selects the media to be used 
and develops the outlines of the ins truct ional strategies for 
the project. The objecfcives f (DrinuJ at'pd are then cirrulntnd to 
other ccjntent exfir^rts who were not involvecJ in tht-r iniiAn] 
forrnulation of objectives for review. This revleisJ' is designed 
to assure that the instructional objeetiTCs selected are complete 
and are conisistent with other aspectH of the curr icu;llujn. 

Suggestions from the other content; experts are incorporated 
and appropriate changes are made. As soon as the instructional 
objectives are finalised., the matarials developer begins work on 
a preliminary version of the materials. This prellTBinary version 
of the materials is not in final forinat.^ It is rather, for ex^ 
am;ple^ in the form of scripts and illustrations with notationvs 
about the relationship of script and the complimentary illustra-^ 
tion. 'These preliminary materials are reviewed by the content 
expert for the project, content colleagues, development oHpertSp 
and selected mornbers from the population for whom the materials 
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are intended* The comments and suggestions frorn this review are 
used to* revise the materials as necessary* 

The next step is the small scale field tryout, wherein the 
instructional materials are examined and v^orked with by a small 
representative group of the population that will ultimately 
use the materials. These evaluators are tested to determine 
their ability to reach the objectives specified* They also eval-- 
uate the materials on an affective level and make suggestions 
for improvements. The results of the small scale field tryout 
are used to determine what further modif icatio'ns (if any) are 
necessary before the implementation of the materials on a large 
scale * 

The large scale field test is usually the first impdemen^ 
tation of the materials in the setting for which they were de^- 
signed. The performance and satisfaction of students is care- 
fully monitored during this first application of the materials 
and evaluation data is gathered to indicate any further revision 
of the materials was may be warranted* After final modifica^ 
tions of the materials, the instructional product can be con- 
sidered complete and ready for further use or dissemination. 
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Figure 1 
The Product Development Cycle 
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Ap plication of the Product Deve lopment Cycle 

One example of the niaterials development projects that has 
been coinpleted is the OASIS Orientation Program. The Orientation 
Program will be the example used to illustrate the application 
of the product development cycle to a particular project. In 
this case, the content experts were members of the OASIS staff, 
primarily the four OASIS program coordinators. The OASIS Direc^ 
tor and the program coordinators specified four general goals 
for the program: 

1. To inform students (and staff) of the types of 
services available through OASIS. 

2, To describe these services and how they relate to 
the regular aCfidemic departments at UCSD. 

3* TO Inforni students (and staff) about the procedures 
by which they can take advantage of OASIS services* 

4. To illustrate the role of OASIS at UCSD as a re= 
search and service oriented program with resources 
available to faculty, staff, and students, including 
new and innovative programs to serve the general 

■ 

academic community , 
After the general goals were specified, the Coordinator 
for Instructional Materials Development met with each program 
coordinator individually to clarify specific goals and objectives 
for the portions of the program that dealt with each coordina- 
tor 's area. The specific goals and objectives that were de- 
veloped relative to each OASIS programmatic area are presented 
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in Appendices I-^V. After objectives relating to each program^ 
inatic area were developed in cooperation with the appropriate 
program coordinator, all the objectives were circulated to all 
the program coordinators and to the Director. Thus, the ob- 
jectives developed in cooperation with each content expert 
(program coordinator) were examined and critiqued by four other 
OASIS professional staff members with some knowledge of the 
content. The objectives were subsequently modified to reflect 
additions and changes found necessary in this first review pro^ 
cess . 

While the review process was taking placa^ the Coordinator 
for Instructional Materials Development began work on a task 
analysis for the activities of OASIS programs, A separate 
task analysis was developed for each program (see Appendices 

, The products were reviewed and corrected by the program 
coordinators. This task analysis of activities was used in the 
developinent of the scripts and visuals for the Orientation Pro^ 
grani • 

Following completion of the task analysis and finalization 
of the objectives^ a preliminary version of the materials with 
a script for the audio and notes on possible visuals to co- 
ordinate with the audio was produced* This preliminary script 
was reviewed by the content eKperts and modifications were made 
based on the feedback received. 

Production of the program was then begun, based on the 
modified script. The necessary photographs and illustrations 




7 



were formatted^ tha audio script recorded^ and the visuals were 
coordinated with the audio. The result was a preliminary ver- 
sion of the program which was viewed by selected students and 
OASIS staff* 

The preliminary version of the program was then ready for 
field testing* A short test was developed to sample attainment 
of tlie program objectives and to obtain formative feedback on 
the program (see Appendix XI) . 

The program was field tested on a group of 20 University 
of California Extension students who were unfamiliar with the 
OASIS program • The students were told that they were to view 
the program for their information. At the end of the program 
the test (OASIS Orientation Questionnaire) was administered. 
The results of this evaluation were quite favorable but also 
suqcieBtoci chanqoB which furthar improvod tho proqram (soo Appon- 
dices XII and XIII), 

The resultant program was then given a large scale field 
test by administration to entering students as a part of their 
orientation to UCSD, The program was viewed by apprOKimately 
190 students during different orientation sessions in coopera- 
tion with six college orientation leaders. A questionnaire was 
then developed to obtain evaluative feedback from orientation 
leaders who had used the program (see Appendix XIV) • This 
questionnaire was distributed to all the orientation leaders 
who used the program* The results of this final evaluation (see 
AppendiK XV) indicate that the program was well received both 
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by orientation leaders and (in the leaders' opinion) by students. 

Subsequent to this large scale field test and evaluation^ 
slight modifications of some portions of the program were made 
to improve congruence of the visual motifs and audio- 
Other Projects 

The OASIS TMD Program is currently Gngaged in SGvoral other 
projects relatc^d to instructional media. These projects include 
the development of programs to teach note-taking f tutor training 
modules for the OASIS tutorial programs training class (TEP 196), 
and training tor tutors to work with the visually limited. A 
niajor project will be the development of se If instructional 
modules to supplement the Science and Technoloqy 1 lA course. 
Appendix XVI provides a tabular represontat ion of progross to 
date on each of these projects* Finally/ tha IMP Program has 
leveloped a media Ejlayback room in the OASIS offices for the 
use of media materials by students. A more detailed description 
of each of these programs follows. 
No te--Taking Program 

The note"-taking prograni will consist of a series of slide 
and videotape programs to explicate a method for takinq lecture 
notes. The program is designed for skill acquisition of note^ 
taking concepts by emphasizing both a model developed at Cornell 
University (Pauk, 1974) and active student par ticipcation * The 
program will include both teachii g media segments to eKplicate 
techniques and practice tapes to provide practice in taking 
notes from videotaped mini^ lectures of actual faculty meiTibars. 

er|c 1 0 



The practice tapes will contain the mini- lecture and a set of 
model notes from that lecture as well as other relevant exercis'^s. 
Teacher Edu cation Prograrn 196 Course Modules 

Teacher Education 196 (TEP 196) is the course used to train 
OASIS tutors- The course has been modularized by content sec-- 
r. ionn which will bo roflnod into a so 1 f ins t ruct i ona 1 format. 
The course includes two basic types of inodules: quest iGctures 
and teaching skills instruction. The guest lecturers were video-- 
taped presenting information on a variety of topics which will 
be edited for inclusion in self-instructional sequences built 
around the topical area of the presentation. The teaching skills 
instruction will also be reorganized and fitted into a compre- 
hensive rnGcixa prosentation ot the material- In ri<kiition, thu 
Coordinator for Instructional Materials Development conducted 
video microteaching exercises with new tutors and all Teachers 
of Ten (TOT) program tutors, 
Vi sually Lii n i tod P ro j ec t 




The visually limited project is a prograni consisting of 
exercises and media materials to provide tutors with a basis for 
understanding and assisting the visually limited. The program 
will provide sensitization to and awareness of the physical capa^ 
bilities of the visually limited. It will also provide teaching 
strategy training to individuals interested in assisting visually 
limited students in their academic careers. Components of the 
program will include slide-tape programs on tutoring strategies 
for the visually limited; simulation exercises; and videotape 




11 



10 



discussions among visually limited students of their needs ^ 
problems, and approaches to the college situation. 
Sc ience and Technology HA Modu les 

The project is designed to improve the teaching of lower- 
division biology through an initial focus on the vertebrate 
zoology course* Upon completion and successful field tryout, 
both the format of the project and some of the learning materials 
may be trans ferrable to other lower division courses. The over- 
all purpose of the project is to develop resources: 1) for 
improving basic learning skills within the context of lower divi- 
sion biology and^ 2) for presenting key biological concepts 
that students have difficulty mastering through the standard 
lecture-- textbook approach. The project has two specific aspects^ 

1, Preparation of learning materials to teach students to 
improve trh^ir learning and test-taking skills* These will be 
in the form of mediated materials with a heavy emphasis on stu^ 
dent participation and exercises. Students will acquire learn^ 
ing skills (time management, organization/ note-taking i test-- 
taking skills^ and general study strategies) by application of 
these principles to course materials. 

2. Initiation of a program to develop six self-instructional 
modules which satisfactorily present key concepts in vertebrate 
Eoology. These modules will be an integral component of instruc- 
tion which will require approximately 45 minutes of student 
learning activity per week. 

The titles of the nine modules planned for the course arei 
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1. Lecture Note'-Taking 

2 . Textbook Reading and Note-Taking 

3. EKamination Skills 

4. Energy and Thermodynainics 

5. Cellular Respiration 

6. Hemoglobin-Oxygen Binding and Unbinding 

7. Diffusion^ Active Transportr and Osmosis 

8* Counter-Current Excharige and Counter-Current 
Multiplication 

9. Negative Feedback Regulation 
Media Playback Room 

This aspect of the IMD Program consista of the development 
of a facility for the use of media ntaterials by students. Care^ 
ful investigation has enabled OASIS to acquire a more flexible 
system than was originally planned. The media playback .room is 
now fully functional with five study carrel stations. Three 
of the stations^ are equipped with slides-tape units and two of 
the stations are equipped with color video cassette playback 
units. All stations are eguipped with headphones to allow five 
or more students to use the facility simultaneously* In addi- 
tioni^ there is a mobile video cassette recorder and monitor for 
use in video microteaching or group viewing of videotape. 
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Appendix I 

Objectives: PTFP Tutoring Program 
After viewing the OASIS Orientation Program, the student will: 
1* Respond positively to a question on the evidence from 
evaluation of the PTFP. 

2. ChoosQ three correct aspects of tutor training from a list 
of five, 

3. List the group of eligible students* 

4. List the course areas that are tutored, 

5, Choose three correct characteristics of the service froin a 
list of seven. 

6, List the time for applying, the location for applyinq, and 
the time for assignrnent of tutors, 

7, Choose two correct purposes of the program from a list of 
five * 
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AppendiK II 

Objectivesi Clinic Frogram 
After viewing the Orientation Prograii!, the studen^t wills 

1. Respond positively to a true^-false question on the evidence 
frorn evaluations of the clinics* 

2, Choose three correct characteristics of the clinic:- from a 
list of seven possibilities. 

3* Choose two correct purposes of the program froni a list of 
f ive, 

4. Choose three correct aspects of the tutor training from a 
list of five. 

5, List the niedia that advertise the clinics* 
6* Describe the procedure for receiving help, 

1, List the student groups eligible for asslBtancQ* 
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AppendiK III 

Objectives-. Reading and Study Skills Program 
After viewing the OABIS Orientation Program^ the stiadent willi 

1, Choose three correct purposes cf the Reading and Study Skill 
Prograyn from a list of sIk. 

2, Correctly list the two modes of presentatioti of instryction, 
3* Choose two correct areas coverad by the ReadiKig and Stady 

Skills Program from a list of five. 
4, Identify the population eligible for the Reading and Stydy 
Skills Program. 

5^ Identify the referral service for Reading aBd Study Skills 
Programs * 

6. List the four steps in applying for reading and study skills 
assistance at OASIS* 

7, Identify the location of Reading and Study Skills Prograins. 
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Appendix IV 

Objectives I Research and Evaluation Component 
After viewing the OASIS Orientation Program, the student willi 
1* List the two areas of OASIS investigation* 

2, Choose three correct aspects of the Resisarch and Evaluation 
Gomponent from a list of five* 
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Appendix V 

Objectives: Visually Limited Program 
After viewing the OASIS Orientation Program, the student willi 

1. List three types of materials availablo for students to 
receive training from* 

2. Describe the procedure for obtaining these riiaterials. 

3. Choose two correct purposes of the OASIS programs from a list 
o^f five possibilities , 
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Appendix XI 
OASIS Orientation QueBtionnaire * 
CIRCLE THK CORRECT RESPONSE TO EACH QUESTION 

1. What do OASIS evaluation studies show? 

a) That female freshinen perform better than males in Math 4B 

b) That tutorial assistance yields higher grades 

c) That mathematics is a useful course, in all disciplines 

d) That socioecondrtld background has no relation to the number 
of students needing tutors 

2. What is the purpose of the regular tutor assistance program? 

a) To provide free social and psychological assistance to stu- 
dents 

b) Solve short-^term, emergeney type problems 

c) To provide help on a no appointment ^ walk=-in basis 

d) Help students integrate course concepts 

3. Which of the following is true about the OASIS program for the 
visually limitGd? 

a) The prograin trains the visually limited in how to attend 
college. 

b) OASIS provides readers for the blind* 

c) The program trains tutors to work with the visually limited, 

d) OASIS provides canes and mobility instruction for the blind. 

4. Which of the following services is not provided in the math/ 
^-sics and biology/chemistry clinics? 



a) Assistance with short-^term problems 

b) Aid on a walk-in basis 

c) Assistance in lower division math and science courses 

d) Tutors to do your homework problems for you 

* Developed by the Office of Academic Support and Instructional Service 
March/ 1976. 
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OASIS Orientation Questionnaire 
Page Two 

5. Which statement is true of the Reading and Study Skills 
prograin? 

a) Provides individual counseling on a one-to-one basis 

b) Is available to all students on a first-come, first- 
served basis 

c) Meets in small group sessions 

d) Has self-instructional materials to work with 

6. information about where and when the math/physics and biology/ 
ehemistry clinics are held is ngt ; 

a) advertised in the Triton Times 

b) available through OASIS 

c) posted on bulletir boards 

d) given out by instructors the first week of class 

7. What should a student do to apply tor regular tutorial assistance? 

a) Come in to the OASIS office 

b) Fill out a form with his/her registration materials 

c) Drop in .at the advertised location and time 

d) Apply through the appropriate academic department in which 
they" are having difficulty 

8. What skill does the Reading and Study Skills program n^ cover? 

a) Managing your time more efficiently 

b) Studying more effectively 

c) ' Taking better notes 

d) Methods to relieve stress 

9. under what conditions do tutors meet with their tutees? 

a) AS often as necessary to solve problems 

b) Only before major examinations 

c) For a maxijmam of three hours per week 

d) On a one-to-one basis or in small groups 
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OASIS Orientation Questionnaire 
Page Three 

0* Which of the following is not a rnaracteristic of OASIS tutors? 

a) Veterans of a formal training course 

b) Any student who can pass a qualifying exam 

c) Students who have a 3.0 or higher CPA 

d) Students who have taken the courses that they tutor 

1, Which of the following is not an OASIS faculty development 
activity? 

a) Examining ethnic and sex influences on academic success 

b) Developing new approaches to education 

c) Evaluating courses 

d) Writing tests for lower division courses 

2, Which statement im true of the Reading and Study Skills program? 

a) It deals with specific skills, such as spelling and grammar* 

b) Classes are held in each of the four colleges on a rotating 
basis* 

c) Students must be referred by an instructor- 

d) Groups are filled on a first«come, first-served basis. 

3, What has evaluation of OASIS tutoring programs shrjwn? 

a) That students feel better about school after being tutored 

b) Tutored students* grades are significantly higher than 
non--tutored students' grades, 

c) Evaluation is new for OASIS, and results thus far are 
inconclusive, 

d) That male tutors yield better results in science courses, 
and female tutors yield better results in mathematics 
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OASIS Orientation Questionnaire 
Page Four 

14. For whom is regular tutorial assistance available? 

a) Lower division math and science students 

b) All courses in 3rd College 

c) Breadth requirement courses in all four colleges 

d) All of the above 

15. Which step is necessary to receive Reading and Study Skills 
assistance? 

a) Be referred by an instructor or counselor 

b) Apply at OASIS for assistance 

c) Have an intake interview with OASIS staff 

d) Take your choice of self-instructional or group progrMis^ 

16. What should a student who needs short-teon academic help do? 
a) Go to a clinic during open hours 

. b) Make an application at OASIS for a regular tutor 

c) Take several exams and wait for his instructor to refer him 
to OASIS 

d) Try to proceed with the course and .solve his own problems 

17. Which of the-following has been examined by the OASIS evaluation 
studies? 

a) Relationship of high school GPA to math. achievement 

b) How prerequisites relate to course performance 

c) Performance in math courses as compared to physics 

d) - Sex differences in drop--out rates at UCSD 

18. Which of the following is a true statement? 

a) Non^clinic tutorial assistance is available to any student 
at any time during the quarter, 

b) Tutors are assigned two weeks before the quarter begins, 

c) Tutors are assigned on a firsts-come, first-served basis- 

d) Students must be referred by an instructor in order to 
receive a tutor. 

28 



General Questions 



Strongly Strongly 
Agree Agree Disagree Disagree 

19. The individual parts of the 
slide^tape presentation were 

clearly related to each other, ____ — — — - - 

Coiranent? 



20. After viewing the slide program^ 
I have enough information to 
clearly understand the OASIS 
program, 

COOTnent? 



21. The voice on the tape was clear 
and underatandable* 

Comment? 



22. The level of the program was 
correct for the audience (not 
too simple, not too difficult). 

Comment? 

23. It was clear what the slides 
represented* 

Coimnent? 



24, The presentation held my 
interest throughout. 

Comment? 

25, Were there any sections of the 
program that were unclear? 

If yes, which ones? 

26, Do you have any other conmients 
for improving the quality of this 
slide-tape presentation? 
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Appendix XII 

Summary of Responses to OASIS Orientation 
Program Questionnaires Content Section 

Topical Area of Question 

PTFP Tutorial Program 
Clinic Tutorial Programs 
Reading and Study Skills Program 
Research and Evaluation Program 
Visually Limited Program 
Note: N = 17 



Percentage Correct 

82% 
95% 
82% 
90% 
79% 
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Appendix XIII 

Suniniary of Responses to OASIS Orientation 
Program Questionnaires Formative Section 



Strongly Strongly 
Agrfeg Agree Disagree Disagree 

The individual parts of the 
si iciest ape presentation 
were clearly related to 

each other. 9 8 0 Q 



After viewing the slide 
program^ I have enough 
information to clearly 
understand the OASIS pro-^ 
gram. 

The voice on the tape was 
clear and understandable. 

The level of the program 
was correct for the 
audience (not too simple, 
not too difficult) . 

It was clear what the 
slides represented. 

The presentation held my 
interest throughout. 

Were there any sections of 
the program that were un- 
clear? 



_0 9 Q 0 

13 3 1 0 

10 6 1 Q 

_8 9 0 0 

8 8 1 0 

Yes 1 No 16 
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Appendix XIV 
OASIS ORIENTATION PROGRAM 
QUESTIONNAIRE II* 



Does the program provide enough information to enable a student 
to determine v/hich services are offered by OASIS? 

DefinUely Probably Probably not Definitely not 



Does it provide enough information to tell ,a student how to 
aDDly for tutorial assistance? 



Definitely Probably _ Probably not Definitely not 

3. Does it provide enough Information to tell a student how to 
enroll in the Reading and Study Skills program? 

Definitely__ Probably ^ Probably not__ Definitley not__ 

4. How suitable do you think this particular program vms for use in 
orientation? 

Very suitable^ Suitable ^ Not very suitable Unsuitable^ 

5. How suitable do you think audio-visual presentations, in generaU 
are for use in orientation? 

Very suitable__ Suitable Not very suitable__ Unsuitable 

6. Was the narration easily understood? 

Very easily Easily Not easily 

understood _ understood^ understood__ Incomprehens i ble_ 



EKLC 



7. Were the visuals easily understood? 

Very easily Easily Not easily 

understood^ understood__ understood Incornprehensi b1e___ 

8. How many visuals did Ml seem to be congruent with the audio? 

noT\e_ A few Many_ Very niany___ 

9. How valuable do you think this program was for the participants 
in your orientation? 

Very valuable___ Valuab1e_ Not very valuable__ Use1ess__ 

* Developed by the Office of Academic Support and instructional 
Services, May, 1976. 
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10. If you had tu choose between this progiam and an OASIS staff 
member to provide information about OASIS, which would you 
choose. Why? 



11. Please describe any portions of this program which need to be 
changed and how you would change them. 
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Appendix XV 

A Tabulation of Responses from the College Orientation 
Leaders to the OASIS Orientation Program Questionnaire 

1* Does the program provide enough intormation to enable a stu- 
dent to determine which services ar^e offered by OASIS? 

Definitely_4 Probably 0 Probaulv not_^ Definitely not 0 

2. Does it provide enough information to tell a student how to 
apply for tutorial assistance? 

Definitely 4 Probably 1 Probably not 0 Definitely not 0 

3. Does it provide enough information to tell a student how to 
enroll in the Reading and Study Skills program? 

Definitely 3 Probably_2_ Probably not 0 Definitely not 0 

4* How suitable do you think this particular program was for 
use in orientation? 

Not very 

Very suitable 3 Suitable 2 suitable 0_ Unsuitable 0 

5* How suitable do you think audio^visual presentations^ in 
general^ are for use in orientation? 

Not very 

Very suitable 3 Suitable 2 suitable 0 Unsuitable 0 

6* Was the narration easily understood? 
Very easily Easily Not easily 

understood understood 1 understood 0 Incomprehensible 0 

7* Were the visuals easily understood? 
Very easily Easily Not easily 

understood 2 understood 3 understood 0 Incomprehensible 0 

8. How many visuals did not seem to be congruent with the audio? 

Nona 3 A few 2 Many 0 Very many 0 

9, How valuable do you think this program was for the partici- 
pants in your orientation? 

Not very 

Very valuable 4 Valuable 1 valuable_^ Useless 0 
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10* If you had to choose between this program and an OASIS 
staff member to provide information about OASIS/ which 
would you choose* Why? 



Response Frequency 



Program preferred 4 
Program is adequate 1 
People are necessary to answer questions 1 



11, Please describe any portions of this program which need 
to be changed and how you would change them* 



Response Frequency 



More information should be included on 

numbers of students serT^sd 1 

Statistical data showing success should 

be included 1 

Should be updated periodically 1 

Need more women and faces of color ^ 

especially in teaching roles 1 

Need to explore biases about tutoring 1 
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